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Abstract 


The defining characteristic of ultra-lightweight and inflatable space structures is 
that they are both very large and very low mass. This makes standard contacting methods 
of measurement (e.g. attaching accelerometers) impractical because the dynamics of the 
structure would be changed by the mass of the contacting instrument. Optical 
measurements are therefore more appropriate. Photogrammetry is a leading candidate for 
the optical analysis of gossamer structures because it allows for the measurement of a 
large number of points, is amenable to time sequences, and offers the potential for a high 
degree of accuracy. The purpose of this thesis is to develop the methodology and 
determine the effectiveness of a photogrammetry system in measuring ultra-lightweight 
and inflatable space structures. The results of this thesis will be considered in the design 
of an automated photogrammetry system for the 16m-diameter vacuum chamber at the 
NASA Langley Research Center. 
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Chapter 1 : Introduction 


In this chapter, a description of ultra-lightweight and inflatable space structures is 
presented, as is a brief history of photogrammetry. A summary of the research discussed 
in this thesis is also provided. 

1-1: Ultra-Lightweight and Inflatable Space Structures 

Ultra-lightweight and inflatable structures hold immense potential for space-based 
applications. These structures have very low densities, thus reducing the payload mass 
requirements for launch vehicles. They can deploy from an initially small, packed 
volume, thus reducing payload volume requirements. These gossamer structures can be 
deployed to great scales, allowing exceptionally large volumes, areas, and lengths to be 
employed in space structures. Within the NASA Gossamer Spacecraft Initiative, concepts 
for inflatable habitats, solar and optical concentrators, antennas, solar sails, and solar 
shades are under study ( 1 ,2,3). 

1-2: A Brief History of Photogrammetry 

Ironically, the mathematical theory behind photogrammetry has existed longer 
than photography. In 1715, Dr. Brook Taylor published the book Linear Perspective 
dealing with the mathematical projection of a three-dimensional scene onto a two- 
dimensional plane. In 1759, J.H. Lambert suggested that the principles of perspective 
could be used to produce accurate maps (4). This would in fact become the primary 
application of photogrammetry, but its use would have to wait until practical photography 
had been developed. 

In 1839, Louis Daguerre publicized his technique for direct photography using 
metal plates coated with light-sensitive silver iodide. In 1849, Colonel Aime Laussedat of 



the French Army Corps of Engineers directed the first experiments in using 
photogrammetry for topographic mapping (4). Colonel Laussedat experimented with both 
terrestrial photographs and aerial photographs taken from balloons and kites, but the 
practical difficulties then associated with aerial photography limited this branch of his 
work. The invention of the airplane by the Wright brothers in 1902 provided the means 
for aerial photogrammetry to develop. Aerial photographs were used primarily for 
reconnaissance in World War I, but it was during World War II that aerial 
photogrammetry was used on a massive scale to meet the urgent demand for maps. 

While still used as a tool in the production of maps, photogrammetry is finding 
applications in such diverse fields as tool inspection, crime scene investigation, and 
motion analysis (4). The use of photogrammetry in map making is known as topographic 
photogrammetry, while the use of photogrammetry in other fields such as those 
mentioned above is known as non-topographic or close-range photogrammetry. While 
the applications of photogrammetry are diverse, the underlying techniques are common. 
1-3: Research Summary 

The purpose of this thesis is to develop the methodology and ascertain the 
effectiveness of using photogrammetry to measure ultra-lightweight and inflatable space 
structures. Experiments relevant to the measurement of the static shape and the 
deployment dynamics of various structures similar to ultra-lightweight and inflatable 
space structures were conducted. 

The process of making photogrammetric measurements of a 5-meter diameter 
inflatable solar concentrator is described. This concentrator was photogrammetrically 
measured to determine what precisions could be obtained and how these precisions varied 


2 



with camera resolution and the number of images used in the measurement. Experiments 
in measuring the deployment of structures composed of inflatable columns are explained, 
with an emphasis give to the techniques used instead of measured results. Discussions of 
general experimental methods applicable to both static and dynamic measurements are 
given throughout. Based on the research experience, recommendations for future work 
are made and concluding remarks on the potential use of photogrammetry in measuring 
ultra-lightweight and inflatable space structures are given. 
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Chapter 2 : Photogrammetric Measurement of the 5m Concentrator 

In this chapter, a brief overview of photogrammetry is given, followed by a 
description of the ultra-lightweight 5m diameter solar concentrator. The process of 
measuring the 5m concentrator using photogrammetry is then described, and the results 
are presented. 

2-1: Overview of Photogrammetry 

Photogrammetry is the science of analyzing photographs to obtain accurate 
measurements of physical objects. A photograph is the projection of a three-dimensional 
scene onto a two-dimensional plane, such as a photographic film or a charge-coupled 
device (CCD)’. The foundation of photogrammetry is triangulation, in which two or more 
photographs are used to reconstruct the three-dimensional coordinates of the 
photographed scene. Triangulation requires knowledge of the orientation of the 
photographic planes with respect to the scene, and so the positions and orientations of the 
cameras must be determined (5, 6). This information, as well as the three-dimensional 
coordinates of the scene can be calculated iteratively and simultaneously using what is 
known as a bundle adjustment algorithm (7). 

The projection of the scene onto the photographic plane will be affected by not 
only the location and orientation of the camera, but also by the physical properties of the 
camera itself. These properties, such as focal length and lens distortion, are determined 
by “calibrating” the camera. Camera calibration can be done by creating a 
photogrammetric model of a scene with known coordinates, such as a grid projected onto 
a flat wall. This is known as a “field calibration.” 

* Charge-coupled devices (CCDs) are used in video and digital cameras to capture and record light. 


4 



When photogrammetric measurements are to be made of a scene, it is important to 
choose camera locations and orientations that will yield the most accurate results. 
Calculation of three-dimensional coordinates requires images of a scene from two or 
more cameras taken at convergent camera angles. Angular separation, or the angle 
between two cameras and the center of the scene, is of considerable importance. An 
angular separation of 90 degrees is optimal to minimize the angular error sensitivity of 
the cameras, but an angle half this size is acceptable: angular separations less than 15 
degrees or greater than 165 degrees should be avoided. The locations and orientations of 
the cameras used to photograph the scene are automatically computed when the 
photogrammetric measurements are calculated, and so it is not necessary to measure and 
record these location while taking the photographs. The scale of a scene cannot be 
determined from photographs that do not contain objects of known size, and so “scale 
bars” (bars of known length) are included in all the scenes imaged in this thesis. 

Once the photographs have been taken, the images are loaded into a 
photogrammetry software package. The software package used in this thesis is 
PhotoModeler Pro from Eos Systems, Inc., which is a consumer-grade photogrammetry 
package. Within the software, the camera calibration parameters are entered and points of 
interest are marked on the photographs. Corresponding points on different images are 
then “referenced” to each other. Referencing tells the software that point A in picture I is 
the same physical point as point B in picture 2. When a minimum number of points have 
been marked and referenced (approximately 10 points per photo), the bundle adjustment 
can be executed and the three-dimensional coordinates of the referenced points as well as 
the camera locations and orientations are calculated. Additional points can be marked and 
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referenced and the bundle adjustment re-executed until all points of interest have been 
measured. 

When the three-dimensional coordinates of all points of interest in the scene have 
been calculated, this data can be exported and studied with other software packages. In 
this thesis, the data was exported and studied in detail using MATLAB from The 
MathWorks, Inc. 

2-2: Overview of the 5m Concentrator 

The test article under study in this chapter is an inflatable parabolic solar 
concentrator manufactured by SRS Technologies in Huntsville, Alabama (Figure 1). The 
concentrator consists of two inflatable structures: the parabolic lenticular and the torus. 
The lenticular has a transparent convex dome covering a highly reflective concave 
parabolic membrane 5m in diameter. The outer diameter of the torus is 6.5m, with a 
cross-sectional diameter of 0.6m. The torus supports the lenticular with a series of thin 
cords attaching the perimeter of the lenticular to the torus. The total mass of the structure 
is roughly 4 kg. Similar structures are being investigated for use in space-based solar 
power generation, solar thermal propulsion, radio and optical astronomy, and antennas ( 1 , 
8, 9). 

Small circular retro-reflective targets have been placed on the lenticular for use in 
photogrammetry studies. Larger square retro-reflective targets have been placed on both 
the lenticular and the torus for use in separate laser vibrometry studies. No 
photogrammetry targets were placed on the torus since the focus of this study is 
determination of the shape of the lenticular. As a matter of convention, this parabolic 
concentrator (both lenticular and torus) will be referred to as the 5m concentrator, and 
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Figure 1: The 5m concentrator mounted in the 16m vacuum chamber. The rear, convex surface of 
the concentrator is shown, and this is the surface measured in this research. 

There are eight steps involved in making photogrammetric measurements. These 

steps are here described in the context of measuring the 5m concentrator (10). 

2-3: Camera Description 

The two primary types of digital still cameras used in this research are the Kodak 
DC290 and the Kodak DC4800. The DC290 has a resolution of 1792 x 1200 pixels (~2 
megapixel) with pixels approximately 4.2 microns square. The DC4800 has a resolution 
of 2160 x 1440 (~3 megapixel) with pixels approximately 3.5 microns square. For both 
cameras, all the photograph used to make photogrammetric measurements and 
calibrations were taken with the built-in zoom lenses set to full wide. 
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2-4: Camera Calibration 


The physical properties of a camera, such as the focal length and lens distortion, 
are known as the “camera parameters,” and the determination of these parameters is 
known as “camera calibration.” Accurate photogrammetry measurements require 
accurate camera calibrations. The camera parameters describe the geometry and 
distortion of the projection of a three-dimensional scene onto the two-dimensional CCD 
of the camera (Figure 2). The photogrammetry software compensates for these geometric 
effects if the camera parameters are known. 



Figure 2: The projection and distortion of a three-dimensional scene onto the CCD of the camera 

In an idealized pinhole camera, all of the light rays are focused through a single 

point in space as they pass through the camera. After the rays pass through this point, the 
image is flipped upside-down and left-to-right. The single point in space through which 
all light rays pass is known as the perspective center of the camera. The principal point of 
the photograph is the projection of the perspective center of the camera onto the 
photographic plane, and is usually near the center of the photograph. In the cameras 
discussed here, the camera lenses focus the light through a finite area, not a single point, 
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and the principal point of these cameras is at the center of the projection of this area onto 
the photographic plane. The exact location of the principal point must be determined by 
camera calibration. 

The K|, K 2 , Pi, and Pi distortion parameters are quantitative measures of four lens 
distortion effects (Figure 3). The Ki parameter measures the radial distortion of the lens, 
which creates a “barrel” or “pincushion” effect. The Ki parameter is similar to the Ki 
effect, but is a higher-order term and thus only identifiable near the edges of the 
photograph and is often negligible. The Pi and Pj parameters measure the misalignment 
of the lens elements. 
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Figure 3: Distortion of points as described by lens distortion parameters. Dots represent points prior 

to distortion; circles represent distorted points. 
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The shift in the location of a projected point onto the image plane due to lens 
distortion is given by the following equations: 

Ax = Kixr 2 + K 2 xr 4 + P|(r 2 + 2x 2 ) + 2P2xy, 

Ay = Kiyr 2 + ICyr 4 + P 2 (r 2 + 2y 2 ) + 2P|Xy, 

. . T ■> 1 

with r' = x“ + y~, 

where Ax and Ay are the change in horizontal and vertical position of the point located at 
x and y, with the origin of the coordinate system located at the principal point of the 
photograph. 

PhotoModeler estimates camera parameters using photographs of a grid pattern 
projected onto a flat wall (Figure 4). This is known as a “field calibration.” The 
photographs used in the field calibration are taken from various locations and 
orientations. There is no need to measure the locations and orientations of the camera 
when taking these photographs because this information is automatically calculated by 
the calibration software. Once these images have been imported into PhotoModeler, the 
user uses the mouse to mark four reference points located in the corners of each photo. 
Once the reference points have been marked, the hand-measured distance between two of 
the reference points on a diagonal of the projected pattern is input into the program. The 
program then begins an automated process to determine the camera parameters. The focal 
length, CCD size (also known as the format size), principal point location, and lens 
distortion parameters are thus determined. 
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Figure 4: Photos used by PhotoModeler in a “field calibration” 


Camera settings such as the manual focus distance and the zoom setting affect 
camera parameters. It is therefore necessary to insure that the camera settings are the 
same each time photographs are taken. The camera settings used to make measurements 
must also be the same as the settings used to make the camera calibration photographs. 
To this purpose, a script for the “Digita” programming language was written for the 
DC290 cameras. This script (see appendix) automatically changed the camera settings 
when the camera is turned on from the default values used to the desired settings used for 
the photogrammetry measurements. The settings used for the DC290 are given in Table 
3. A limited number of photographs were also taken with the DC4800 digital camera. The 
DC4800 does not use Digita scripts, and so the settings had to be changed manually every 
time the camera was used. 


Table 1: DC290 settings 






The accuracy of the camera parameters is critical for obtaining accurate 
photogrammetry measurements. Therefore, each of the four Kodak DC290 digital 
cameras used in this research was calibrated multiple times over the course of several 
days. The variation in camera parameters for one of the DC290 cameras is shown in 
Table 1. The average camera parameters for each DC290 were used for the 
photogrammetry measurements, and these are shown in Table 2. A computer simulation 
of the distortion described by the K1 parameter typical of the DC290 used is shown in 
Figure 5. The K1 parameter is the dominant parameter, as can be seen in Table 1. 


Table 2: Camera Parameters for DC290 #1 


Camera 1 

Focal 

Length 

(mm) 

Format 
Size W 
(mm) 

Format 
Size H 
(mm) 

Principal 
Point X 
(mm) 

Principal 
Point Y 
(mm) 

K1 

K2 

PI 

P2 

Day I 

8.2282 

7.5593 

5.04 

3.8134 

2.4521 

I.686E-3 

-4.817E-5 

-3.897E-5 

-3.13E-4 


8.2086 

7.5324 

5.04 



I.824E-3 

-4.646E-5 

7.049E-5 

-7.469E-5 

Day 2b 

8.1990 

7.5328 

5.04 

3.8549 

2.5442 

1.733 E-3 

-3.98E-5 

-2.056E-5 

-5.871E-5 


8.1872 

7.5324 

5.04 

3.8226 

2.5650 

1.698 E-3 

-3.999E-5 

2.966E-5 

1.604E-6 

Day 3a 

8.2019 

7.5333 

5.04 

3.8514 

2.5460 

1.788 E-3 

-4.725E-5 

-4.744E-5 

-7.821E-5 

Day 3 b 

8.2008 

7.5330 

5.04 

3.8470 

2.5437 

1.717 E-3 

-3.892E-5 

-1.291E-5 

- 1 .059E-4 

Day 4a 

8.1975 

7.5360 

5.04 

3.8494 

2.5353 

1.753 E-3 

-4.249E-5 

2.941E-5 

-6.1 IE-5 

Day 4b 

8.2023 

7.5342 

5.04 

3.8517 

2.5433 

1.744 E-3 

-4.096E-5 

2.141E-7 

-9.69E-5 

Day 4c 

8.2028 

7.5367 

5.04 



1.721 E-3 

-4.01 7E-5 

2.684E-5 

-5.706E-5 

Mean: 

8.2031 

7.5367 

5.04 

3.8419 

2.5366 

1.740 E-3 

-4.269E-5 

4.082E-6 

-9.377E-5 

Std. Deviation: 

0.01 10 

0.0086 

0 

0.0145 

0.0327 

4.353E-5 

3.610E-6 

3.815E-5 

8.772E-5 


Table 3: Camera parameters used for photogrammetry measurements 



Focal 

Length 

(mm) 

Format 
Size W 
(mm) 

Format 
Size H 
(mm) 

Principal 
Point X 
(mm) 

Principal 
Point Y 
(mm) 


K2 


P2 

DC290 #1 Mean: 

8.203 

7.537 

5.04 

3.842 

2.537 

0.00174 

-4.27E-5 

0.41E-5 

-9.38E-5 

DC290 #2 Mean: 

8.206 

7.532 

5.04 

3.888 

2.349 

0.00155 



-4.19E-5 

DC 290 #3 Mean: 

8.181 

7.531 

5.04 

3.822 

2.420 

0.00163 



0.03E-5 

DC290 #4 Mean: 

8.232 

7.533 

5.04 

3.843 

2.504 

0.00162 

-4.18E-5 

-2.46E-5 

-9.18E-5 
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Figure 5: K1 distortion typical of DC290 cameras 
2-5: Measurement Planning 

The number of photographs taken and the horizontal and vertical angular 
separations of the camera locations will affect the accuracy of a photogrammetric 
measurement. It is also necessary to include at least one scale bar in the photographs. It is 
therefore essential to plan the measurements before any photographs are taken. The 5m 
concentrator was mounted horizontally (the line of symmetry of the 5m concentrator was 
horizontal) for all photogrammetry experiments discussed in this thesis. Two scale bars, 
one vertical bar located to the left of the 5m concentrator, and one horizontal bar located 
below the 5m concentrator, were added to the photographed scene for scaling purposes. 

The importance of angular separation can be seen in the following example. 
Suppose we are trying to find the two-dimensional location of a point by triangulation 
using a linear CCD array (Figure 6). The linear CCD array can resolve the projection of 
the point onto the array to a certain precision (e.g. one pixel). In order to triangulate the 
two-dimensional location of the point, the linear CCD array must image the point from 


13 



two locations with a non-zero angular separation. If we use an angular separation of 90°, 
we achieve a much more precise measurement of the XY location of the point than if we 
use a separation of 10°. That is, with a 90° angular separation, any uncertainty in the 
knowledge of the camera pointing direction translates into much less triangulation 
uncertainty, particularly in the y direction. 


Good precision in X direction 


Good precision in X direction 
=$t Good precision in 


U 


Y direction 


Poor 

precision in 
Y direction 


linear CCD array 



90°angular separation 0 

10 angular separation 

Figure 6: Triangulating the two-dimensional location of a point using a linear CCD array 

Because it is desirable to have the scene appear as large as possible in the 
photographs (for the same reason it is desirable to have high-resolution photographs), the 
cameras were placed as close as possible to the 5m concentrator. Using the DC290 
cameras with the zoom lens set to the full wide position, the cameras had to be at least 
8m from the 5m concentrator for the entire 5m concentrator and the scale bars to be 
visible in each photo. Up to 9 photographs were taken per photogrammetry measurement. 
To achieve the desired vertical angular separation, photos were taken from floor level, at 
the top of a stepladder, and on a 6m-high scaffold. The floor and the height of the 
available scaffold prohibited larger vertical separations. Horizontal separation was 
achieved by moving the floor, ladder, and scaffold locations approximately 4m to the left 
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and right of the center (Figure 7). Larger horizontal separations were not used because 
the far edge of the convex concentrator surface would not be visible in the resulting 
pictures. This arrangement yielded a maximum vertical angular separation of 33.6 
degrees and a maximum horizontal separation of 58.5 degrees. The angular separation 
between diagonally opposed cameras (e.g. the top left and bottom right cameras) is 67.5 
degrees. In the case of 4 photograph measurements, only the top left, top right, bottom 
left, and bottom right camera locations were used. 



Figure 7: Camera locations used for photographing the 5m concentrator. At left, a front view is 


shown. At right, a skewed view is shown. 

2-6: Taking the Photographs 

To aid in the accurate marking of points, high contrast photographs are desirable. 
The contrast between the retro-reflective targets and the 5m concentrator was maximized 
by using the built-in camera flash with the ambient lights turned off. The resulting 
photographs are underexposed with the retro-reflective targets appearing as bright white 
ellipses on a black background (Figure 8). This type of photograph is ideal for 
photogrammetric measurements because the points of interest (in this case, the retro- 
reflective targets) are clearly distinguished from the rest of the scene. 
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Figure 8: Example of an underexposed photograph of the 5m concentrator used in photogrammetry 
An important feature of the bundle adjustment algorithm used in photogrammetry 
is that it will automatically determine the locations and orientations of the cameras used 
to make the photogrammetry measurements. This removes the need for the photographer 
to measure the camera locations while taking photographs. By using a short exposure 
time, the camera can be hand-held by the photographer and not affected by slight 
vibration, eliminating the need to use vibrations isolation equipment or tripods for the 
cameras. 

2-7: Importing the Photographs into the Photogrammetry Software 

The Kodak digital cameras store image files on CompactFlash memory cards. 
These cards are solid-state devices with storage space ranging from 4 to over 200 
megabytes. Each photograph is stored as a JPEG file approximately 500-kilobytes in size. 
Peripheral card readers can be installed on computers so that the transfer of image files 
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from camera to computer is as simple as removing the CompactFlash card from one and 
inserting it into the other. The files are typically transferred from the card to the hard disk 
of the computer and from there are imported into the photogrammetry software, 
PhotoModeler. When the images are first loaded in PhotoModeler, the user associates 
each picture with a camera calibration file corresponding to the particular camera used to 
photograph the image. 

2-8: Target Marking 

Once the images are imported into PhotoModeler, the retro-reflective targets are 
marked. Each circular target appears as an ellipse whose aspect ratio varies with the 
relative orientation of the camera. Each ellipse is approximately 5 to 10 pixels in size in 
the photographs. Using the sub-pixel marking function of the PhotoModeler software, 
the location of the center of each target is determined with an accuracy of 1/10 of a pixel 
or better. The user defines a rectangular perimeter around the target and PhotoModeler 
determines the center of the target and marks and records the location. Large numbers of 
targets in a user-selected area of the image can also be marked with sub-pixel accuracy 
using an automatic target marking function in PhotoModeler. The sub-pixel target marker 
works similarly to a curve-fitting algorithm (Figure 9). 


. Sub-pixel 



Figure 9: The sub-pixel target marker 

2-9: Target Referencing 


Sub-pixel 
target center 
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Target referencing means identifying targets on multiple images that represent the 
same physical target on the structure. A small number of targets (typically between ten 
and twenty) must be referenced manually before the locations and orientations of the 
photographs can be determined by processing the data using the bundle adjustment 
method. Thus, not only are the three-dimensional locations of the initially small set of 
referenced targets calculated, but also the three-dimensional location and orientation of 
the cameras used to photograph the scene are found. This allows the PhotoModeler 
software to then automatically reference the remaining points. This feature, along with 
automatic target marking, allow for more than 500 targets on the 5m concentrator to be 
marked and referenced on multiple photographs much more efficiently than if these tasks 
were to be done manually, as was the case with the original version of the PhotoModeler 
software used in this research. 

2-10: Processing the Data (Bundle Adjustment) 

Processing the data with the bundle adjustment method in PhotoModeler is a 
largely transparent procedure for the user. When enough targets have been marked, the 
data can be processed and the bundle adjustment executed. The bundle adjustment does 
several things iteratively: it calculates the three-dimensional locations of the referenced 
targets, it calculates the location and orientation of the photographs, and it can adjust the 
camera parameters to obtain results that are more consistent. This is all accomplished in a 
nonlinear least-squares solution with 2xNxn equations in 6xN + 3xn + 8xc unknowns, 
where N is the number of cameras, n is the number of points, and c is the number of 
cameras being calibrated. For example, if one camera is used in 4 different locations to 
photograph 500 points, there are 4000 equations and 1532 unknowns. There are several 
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variations of the bundle adjustment, with various options and levels of sophistication (8). 
Because the position and orientation of the photographs affects the calculated location of 
the points, and because the location of the points is used to determine the position and 
location of the photographs, the algorithm runs through successive iterations until a 
specified precision or maximum number of iterations is reached. 

2-11: Exporting the Three-Dimensional Coordinate Data 

Exporting the data from PhotoModeler is straightforward. The calculated three- 
dimensional locations of each referenced target, along with other data such as the 
precision of the calculated location measurement, can be exported in a number of formats 
including text files. For the data analyses discussed here, the PhotoModeler data were 
exported to a text file and subsequently read into Matlab. 

2-12: Precision of 5m Concentrator Measurements 

The precisions of photogrammetrically determined three-dimensional 
measurements are automatically calculated for every point in PhotoModeler. These 
precision values represent two standard deviations, giving a 95% confidence interval for 
that point (i.e. a 95% probability that the true point falls within the interval defined by the 
precision numbers assuming that bias errors are zero) (11). Each point has separate 
measurement precisions in the x, y, and z directions. 

The 2-megapixel Kodak DC290 and the 3-megapixel Kodak DC4800 were used 
to make separate photogrammetric measurements of the 5m concentrator. A specialized 
VSTARS digital camera, with a resolution of 3070 x 2056 pixels (~6 megapixels) and 
pixels approximately 9 microns square was used to make additional photogrammetric 
measurements. These various cameras were used to examine the effects of camera 
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resolution on measurement precision. Two sets of measurements were made with the 
DC290 cameras: one using four photographs and the other using nine photographs. This 
was done to examine the relationship between the number of photographs and the 
precision of the resulting measurements. The precisions of these measurements are given 
in Table 4. For each set of measurements, the precisions in each direction were examined 
by finding the maximum, minimum, mean, and standard deviation of the point precisions. 
In all measurements, the x direction is horizontal, the y direction is vertical, and the z 
direction is along the line of symmetry of the 5m concentrator. The root-sum-square of 
the precisions was then calculated to provide an over-all precision of each measurement 
method. 


Table 4: Precisions of the 5m concentrator measurements in inches 


Four Photo DC 290 (2 megapixel) 

Min 

Max 

Mean 

Std Dev. 

X precision: 

0.003 

0.023 

0.009 

0.004 

Y precision: 

0.015 

0.041 

0.018 

0.004 

Z precision: 

0.037 

0.112 

0.052 

0.024 

Root-sum- square: 

0.040 

0.121 

0.056 

0.025 

Four Photo DC 4800 (3 megapixel) 





X precision: 

0.012 

0.031 

0.016 

0.003 

Y precision: 

0.023 

0.047 

0.029 

0.004 

Z precision: 

0.014 

0.042 

0.019 

0.004 

Root-sum-square: 

0.029 

0.071 

0.038 

0.006 

Nine Photo DC 290 (2 megapixel) 





X precision: 

0.013 

0.032 

0.018 

0.004 

Y precision: 

0.016 

0.040 

0.022 

0.004 

Z precision: 

0.023 

0.062 

0.026 

0.004 

Root-sum- square: 

0.031 

0.081 

0.039 

0.006 

Nine Photo VSTARS (6 megapixel) 





X precision: 

0.003 

0.024 

0.006 

0.001 

Y precision: 

0.010 

0.021 

0.012 

0.002 

Z precision: 

0.021 

0.069 

0.031 

0.007 

Root-sum-square: 

0.023 

0.076 

0.034 

0.007 


If the root-sum-square value of the mean precision (in bold print) is used to 
measure the overall precision of each set of measurements, it is seen that precision 
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increases with camera resolution (e.g. the 2-megapixel DC290 is less precise than the 3- 
megapixel DC4800 when an equal number of photographs are used). Measurements 
made using four DC290 photographs are less accurate than measurements made using 
nine DC290 photographs, which indicates that increasing the number of photographs 
used in making photogrammetric measurements also increases precision of the 
measurements. Indeed, using nine 2-megapixel DC290 photos yields precisions similar to 
those obtained by using only four 3-megapixel DC4800 photos. This is an important 
result because it allows for trades to be made between the cost per camera and the total 
number of cameras needed in a photogrammetry system. 

The current cost of the DC290 is approximately $700, and the cost of the DC4800 
is approximately $800. A system of nine DC290 cameras would therefore cost about 
$6300, and a system of four DC4800 cameras would cost about $3200. Although each 
system will have about the same precision, the four-camera DC4800 system is just over 
half the price of a nine-camera DC290 system, obviously making the DC4800 system 
preferable. 

Another interesting result is that while the nine-photo VSTARS measurements 
(processed by PhotoModeler) are more precise than the nine-photo DC290 
measurements, the increase in precision is not as great as one might expect when 
considering the increase in accuracy between the four-photo DC290 and four-photo 
DC4800 measurements. The increase in precision in the later case is approximately 50% 
(0.038” vs. 0.056”), corresponding to an increase in camera resolution of 50% (2- 
megapixel vs. 3-megapixel). However, the increase in accuracy between the nine-photo 
DC290 measurements and the nine-photo VSTARS measurements is only 15% (0.034” 


21 



vs. 0.039”), corresponding to an increase in camera resolution of 200% (2 megapixel vs. 
6 megapixel). This may be due to limitations in the $700 consumer-grade PhotoModeler 
software. Alternatively, it may be due to the apparent sizes of the targets in the 
photographs used to make the measurements. Both the DC290 and DC4800 image the 
targets such that the targets are between 6 and 10 pixels across. The VSTARS camera 
images the targets such that the targets are between 4 and 5 pixels across, and this small 
target size may lead to poor sub-pixel marking accuracy. While the reasons for the lack of 
significant precision improvement using the VSTARS camera are not known, it is worth 
mentioning that the VSTARS camera is specifically designed for use with specialized 
software. When the VSTARS camera is used with the VSTARS photogrammetry 
software, a professional system costing roughly $150,000, the precision specification is 
0.005” for a structure the size of the 5m concentrator. This is roughly ten-times as precise 
as the results obtainable using the commercial Kodak cameras and PhotoModeler 
software, but precisions of this level may not be justified given the high increase in cost. 
2-13: Paraboloid Fitting 

The 5m concentrator surface is designed to be parabolic. This shape allows it to 
act as an effective solar concentrator or antenna. It is therefore of interest to determine 
how well the photogrammetrically measured points describe a parabolic surface. 

An analysis algorithm, “Fitparabola.m” (shown in the Appendix), was developed 
in Matlab to fit the xyz locations of the points measured in PhotoModeler to a parabolic 
surface. Once the algorithm has read the xyz data, the data must be oriented such that the 
z-axis of the data is aligned with the axis of symmetry of the parabolic concentrator. 
Once this is done, the data are fit to a surface of the form: 
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z = ax 2 + by 2 + cx + dy + e 

The focal length of the surface is then determined as well as the root-mean-square error 
of the fit. An independent algorithm developed at SRS Technologies in Huntsville, 
Alabama (where the 5m concentrator was designed and manufactured), was used to 
check the results of this algorithm. The results of both algorithms for various data sets are 
shown in Table 5. 


Table 5: Results of the paraboloid fitting algorithms 



Focal Length 

RMS 

Curve Fitting Algorithm 

Fitparabola.m 

SRS 

Fitparabola.m 

SRS 

Four Photo DC290 

120.9013” 

120.9006” 

0.0612” 

0.0614” 

Nine Photo DC290 

1 19.7064” 

1 19.7026” 

0.0596” 

0.0598” 

Four Photo DC4800 

120.7605” 

120.7575” 

0.0559” 

0.0594” 

Nine Photo VSTARS 

1 19.7441” 

119.7394” 

0.0551” 

0.0596” 


Excellent consistency can be seen between the results of both Fitparabola.m and 
the SRS algorithm. The 5m concentrator was designed to have a focal length of 120.0” 
and an RMS surface error of less than 0.0397” (=lmm), and the photogrammetric 
analysis done by SRS of the 5m concentrator after construction at SRS Technologies in 
Huntsville, Alabama, measured an RMS surface error of 0.0096”. The difference between 
these numbers and the ones found here may be potentially caused by either the precision 
of the measurements (which are on the order of the calculated RMS error) or the fact that 
the 5m concentrator has been deflated, packed, shipped, and re-inflated many times since 
the original photogrammetric analysis. 

2-14: The Effects of Blooming on Precision 

When photographs are taken with an intense flash, the retro-reflective targets in 
the scene can appear larger in the photo than they actually are. This effect is known as 
“blooming.” The effects of blooming on the precision of photogrammetric measurements 
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made using sub-pixel targeting are not well known. Blooming may improve precision by 
effectively increasing the size of the targets and thus the precision of the sub-pixel 
targeting. However, blooming will not necessarily be a symmetric effect, and as such, it 
might add random error to the measured location, which is undesirable. 

To test the effects of blooming on precision, the 5m concentrator was 
photographed from three camera stations using the DC290 camera. At each station four 
photos were taken, each at a different flash intensity. The flash was covered with an 
increasing number of layers of masking tape to reduce the flash intensity. Four 
photogrammetric measurements were then made, each corresponding to a certain flash 
intensity. The root -sum- square of the precisions for each case and the corresponding flash 
intensity reductions are given in Table 6. 


Table 6: Precision of each case and the corresponding flash intensity reductions 


Case: 

A 

B 

C 

D 

Layers of masking tape covering the flash: 

0 

1 

2 

3 

Root-sum-square max precision 

0.3655” 

0.5844” 

0.4927” 

0.4915” 

Root-sum-square min precision 

0.0504” 

0.0553” 

0.0559” 

0.0560” 

Root-sum-square mean precision 

0 . 0832 ” 

0 . 1052 ” 

0 . 1132 ” 

0 . 1125 ” 

Root-sum-square Std Dev. precision 

0.0269” 

0.0427” 

0.0456” 

0.0456” 


It is seen that Case A is most precise and has the most intense flash, implying that 
in this case blooming may have improved the precision of the measurements. Not only is 
the mean value of precision for Case A the lowest, but so is the maximum value and 
standard deviation. It is interesting to note that Case C and D are nearly identical in 
precision. This may be due to the fact that at these flash intensities, blooming has been 
eliminated. Repeating this experiment with a more-accurate way of controlling the flash 
intensity (e.g. an external, adjustable flash unit) may provide a clearer picture of what 
effects blooming has on precision. The geometry of a particular test article may also 
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affect any asymmetric blooming, and so an adjustable flash unit is recommended for the 
16m vacuum chamber system. 

2-15: Conclusions on the 5m concentrator measurement 

It has been shown that the 5m concentrator can be effectively measured using 
commercial digital cameras and photogrammetry software. These measurements are 
precise enough to allow comparisons to be made between the measured shape of the 
structure and the engineering specifications such as the focal length. 
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Chapter 3 : Experiments in Videogrammetry of Deploying Structures 

In this chapter, experiments in measuring the deployment of structures composed 
of inflatable columns are discussed. A comparison of different types of targets is also 
given, as is an evaluation of candidate membrane materials to be measured using a 
technique known as “dot projection” in which physical adhesive targets are replaced with 
targets optically projected onto the test article. An experiment in photogrammetry 
software development, in which the analysis software interfaces directly with the 
measurement software, is also discussed. 

3-1: Introduction to Videogrammetry 

One of the primary advantages of ultra-lightweight and inflatable structures in 
space applications is the ability of these structures to transition from an initially small, 
packed volume to a large, deployed configuration. Understanding the deployment 
dynamics of ultra-lightweight and inflatable space structures is a key element of making 
them a reliable and robust technology. Because attaching traditional shape or vibration 
measurement devices to a deploying structure could significantly affect dynamic 
measurement, non-contacting optical measurements of the deployment process are 
desirable. Photogrammetry can be applied to measuring the geometry of these structures 
during deployment using a technique known as videogrammetry, which is essentially 
photogrammetry applied to a time sequence of images. 

3-2: Overview of Polytubing Structures 

To evaluate videogrammetry application to deploying structures, inexpensive 
polyethylene tubes (“Polytubing”) were used to make test articles. The Polytubing 


26 


structures discussed here used black, 6-mil Polytubing manufactured by Uline, Inc., 
which is commonly used in the packaging industry. Polytubing offers several advantages 
as a deployment test article: it is flexible enough to be inflated and deflated; it is rugged 
enough to withstand multiple deployments; it comes in a variety of colors (transparent 
and black, in particular); and it is inexpensive and easy to work with. 

Two types of deployable test articles were made of Polytubing: single columns 
and tripods. The single-column test articles consisted of a length of Polytubing (typically 
ranging from 36” to 60” long), which was heat sealed at one end and attached to a 
mounting plate at the other end. The mounting plate provided an air-hose connection as 
well as a stable base for the structure. Tripod test articles consisted of three single column 
articles joined at the heat sealed end. Each of the columns composing the tripod had a 
separate base plate and was inflated using a common air hose. A pressure regulator was 
installed between the high-pressure shop air supply and the test articles. The inflation 
pressure applied controlled the deployment speed of the tripods and columns. 

3-3: Experimental Setup of VMD2Cam System 

Videogrammetric measurements of deploying test articles were made using the 
Video Model Deformation Two Camera System (VMD2Cam) developed by High 
Technology Corporation. The system uses two cameras, a frame grabber, and a personal 
computer running the VMD2Cam software to track in real-time the three-dimensional 
locations of high-contrast targets. Originally designed to unobtrusively measure the wing 
deformation of wind-tunnel models at the NASA Langley Research Center, the system 
was here used successfully to measure the deployment of Polytubing test articles. 
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The steps involved in making photogrammetric measurements (i.e., camera 
calibration, measurement planning, taking the photographs, importing the photographs 
into the photogrammetry software, target marking, target referencing, processing the data, 
and exporting the three-dimensional coordinate data) are also incorporated in the 
VMD2Cam system. The positions of the two cameras relative to the test article are 
chosen first, corresponding to the measurement planning stage. Once the cameras are in 
position, the cameras are calibrated by imaging the optical targets on a test article of 
known dimensions. The dimensions of the test article are copied into a file accessed by 
the VMD2cam software, and with this information the camera parameters and the camera 
locations and orientations are calculated. Obtaining the location and orientation of the 
cameras prior to measurement speeds the calculation of the locations of the targets during 
measurement, but also requires that the cameras be re-calibrated if the cameras are 
moved. The frame grabber simultaneously digitizes the analog video signals from each 
camera and imports the digital images into the software. Before the test article is 
deployed, the targets are marked and referenced in single photographs taken by each 
camera. During deployment, the software automatically tracks the targets from their 
initial locations, alleviating the need to mark and reference targets in every photograph in 
the time-series of images taken by the system. As the software tracks the locations of the 
targets on the deploying test article, the three-dimensional locations of those targets are 
calculated and exported to a text file. The text file contains the time-referenced locations 
of every marked target during deployment. Matlab was then used to visualize the 
exported data. 
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3-4: Single-Column Tests 

The simplest type of test article used was a single column. The objective of these 
experiments was to develop a way to reliably track the locations of targets placed on the 
column as it deployed. Because the VMD2Cam system uses only two cameras, the 
targets on the column had to stay near a certain orientation, otherwise the targets would 
become hidden from one or both of the cameras and position data would be unobtainable. 
The resolution to this issue was obtained by investigating the methods of packing the 
columns to insure a measurable deployment. 

3-5: Packing of the Single-Column Test Articles 

Existing methods of packing inflatable/deployable tubes are the “Z-fold” and 
“roll” methods (Figure 10). In both of these methods, the tube is flattened prior to 
packing. In a Z-fold, the flattened tube is folded over itself repeatedly. In a roll, the tube 
is rolled up over itself. 



Both of these packing methods were found to be inadequate during testing. The 
columns were intended to deploy vertically, extending in either an upward or downward 
direction. Nether method allowed a downward deployment because the columns would 
deploy on their own by the force of gravity and thus end the deployment tests before they 
began. Tube packing using both methods also failed to deploy upwardly in a reliable 
fashion, with partially inflated columns toppling over at various stages of deployment. 


29 



When the columns toppled, the attached targets moved out of view and position data 
became unobtainable. These failings were due to gravity, and both might be corrected 
with the use of Velcro between the packed layers of the column. Instead of pursuing 
modifications to these methods, however, a new packing method was developed that 
would perform in the desired fashion. 

3-6: The Cuff-Fold 

The Cuff-fold is an original method of packing deployable tubes developed 
during the course of this research. The Cuff-fold is a method of packing deployable tubes 
so that the deployment of the tube is more reliable and predictable than the other methods 
examined (Figure 1 1). The increased reliability and predictability of the Cuff-fold has 
two primary advantages. Because of these improvements, this method can be used in both 
experiments and applications with greater confidence. In addition, these improvements 
also simplify the planning and measurement stages of videogrammetric measurement of 
the deployment. Another practical advantage of the Cuff-fold is that the friction of the 
Cuff-fold packing method allows packed tubes to be suspended upside down without 
deploying unintentionally. 



offset 

_L_ 
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The cuffs can be offset as shown in Figure 1 1, allowing retro-reflective targets to 
be placed on the exposed portion of each cuff and thus allowing a videogrammetric 
analysis of the deployment. Alternatively, the cuffs can be completely nested, in which 
case only the outer-most cuff would be visible initially. This second approach is more 
difficult for photogrammetric analysis, but the packaged volume is smaller and thus more 
practical in space applications. Experimental analysis of Cuff-folded tubes with offsets 
should allow general analytical models of Cuff-folded tubes to be validated, which could, 
in turn, be used to predict the dynamics of Cuff-folded tubes that are completely nested. 
When deploying, Cuff-folded tubes extend in a nearly telescopic fashion. The 
deployment of Cuff-folded tubes is linear and orderly, which is advantageous for both 
measuring the tube during deployment and for evaluating the potential applications of 
deployable tubes in space structures. 

Deployment measurement of Cuff-folded columns proved to be the most 
successful of all single column deployment tests. Although the Cuff-folded columns did 
tend to topple when deploying upwardly, downward deployment tests were successful in 
yielding position data of targets on the column during deployment. Figure 12 shows the 
three-dimensional coordinates of targets placed along the column during various stages of 
deployment. The data corresponding to the initial configuration of the column is shown in 
the upper-left portion of Figure 12, where the column is suspended vertically and packed 
using a Cuff-fold with targets placed on the offsets. A horizontal set of four reference 
targets is also visible above the column. The “current frame” above each image indicates 
the location of the data in the time sequence, which covers 176 individual three- 
dimensional measurements. It can be seen that as time progresses, the column deploys 
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downward in a reasonably linear fashion until the final, deployed configuration is 
achieved in the lower-right portion of Figure 12. 


current frame =1 current frame =36 current frame -71 



current frame =106 current frame =141 current frame =176 



x y x y x y 

Figure 12: Downward deployment tests data from a Cuff-folded column. The four static points near 
the top of the column are a reference attached to the supporting structure. 


3-7: Tripod Tests 

To help understand the issues involved with the deployment of complex structures 
consisting of multiple components, the inflation of Polytubing tripods was also studied. 
The goal of the experiments was to use the VMD2Cam system to gather position data 
from targets placed on two or three legs of the tripod as it deployed. It became obvious 
early in the tests that measuring targets on all three legs would be prohibitively difficult 
using the two-camera VMD2Cam system. 

Two configurations were used in attempts to measure all three legs (Figure 13). In 
each configuration, one leg was centered in the field of view of both cameras with the 
other two legs visible near the edges of each view. In Configuration A, the center leg was 
placed toward the cameras. This configuration failed because the center leg was found to 
block the other legs from the view of each camera during deployment. In Configuration 
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B, the center leg was placed away from the cameras. This configuration also failed 
because the view of the center leg was blocked by the other two legs during deployment. 
Surrounding the tripod with cameras would have enabled at least two cameras to view 
each leg during deployment. However this was not possible using the VMD2Cam system. 
The tripod tests were therefore constrained to measure only two of the legs at a time 
during deployment in a configuration similar to Configuration B. 



Figure 13: Configurations used in attempts to measure ail three tripod legs 

Even during the measurement of only two legs, targets were frequently lost from 
the view of either or both cameras. Typically, this was due to the orientation of the targets 
relative to the cameras, and the problem could likely be eliminated by using a 
videogrammetry system with more cameras. Another difficulty encountered during these 
tests was a more fundamental problem involving complex deployable structures. As the 
tripod deployed, it was possible for two or more legs to move into a configuration from 
which full deployment became impossible. This situation was termed “locking.” Locking 
could be induced by the way the structure was packed (Figure 14). Locking occurred 
because two or more of the legs would push in opposite directions at the vertex, which 
constrained further deployment. Figure 14 shows the folding approach used to avoid 
locking of the tubes. 
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Figure 14: The top series illustrates the front two legs of a tripod transitioning from a packed state to 
a “locked” state; the bottom series illustrates the front two legs of a tripod transitioning from a 
different packed state to a successfully deployed state 

3-8: Retro- Reflective vs. Flat White Targets 

During deployment, the geometry of the structure will change significantly and 
any targets attached to the structure will likely pass through a variety of orientations 
relative to the cameras. In order for tracking software to be effective, the targets must 
remain as visible as possible during the entire deployment process. Both retro-reflective 
and flat white targets were used during the VMD2Cam series of videogrammetry 
measurements of deploying structures, with both types of targets proving useful but 
without a conclusive “best choice.” 

A series of tests were conducted to understand how the visibility of retro- 
reflective and flat white targets change as the angle between the camera and the normal to 
the targets increase (Figure 15). Retro targets are very reflective, particularly with flash 
illumination, and flat white targets are similar to white paper. Both types of targets were 
punched from sheets of the material, and pairs of retro and flat white targets were 
attached to a support (Figure 15). Four sets of target pairs were placed at varying angles 
(Oo, 45°, 6(P, 750) relative to the camera and photographed under varying lighting 
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conditions. The targets were illuminated by a variable light source placed as close to the 


camera as possible. 




Figure 15: Experimental setup of the target comparison tests 
Left- The relation between the camera and the normal of the target. 

Right- A photo of a pair of targets attached to a support. 

A Matlab function was written to analyze the resulting variation in visibility as a 
function of angle. Figure 16 shows the results of this analysis. Amplitude refers to the 
peak intensity of the target as imaged by a DC290 camera, and ranges from 0 to 255. 
Retro-reflective targets are more visible than flat targets at a given light level at most 
angles. However, the visibility of retro targets drops off much faster than flat white 
targets at high angles of incidence. Because flat white targets have a more-constant 
visibility over a wider range of angles, these targets are probably the better choice for 
videogrammetry involving deploying structures that will drastically change geometry. 
For measurements involving less dramatic changes in geometry, retro-reflective targets 
may be preferred due to the increased visibility at lower light levels and generally higher 
contrast with the surrounding structure. 



Figure 16: Variation in amplitude as a function of angle for various targets and lighting conditions 
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3-9: Dot Projection and Membrane Materials 

One promising alternative to using physical targets for both static and dynamic 
shape analysis is dot projection, in which dots of white light are projected onto a surface 
and used as targets for the purpose of photogrammetry (Figure 17). The benefits of dot 
projection are twofold: dot projection allows for thousands of targets to be quickly and 
easily distributed on a surface, and dot projection eliminates the effects of placing 
physical targets on a surface, which add undesirable mass or stiffness to an ultra-light 
structure. These advantages make dot projection an attractive option for ultra-lightweight 
membrane structures. 



Figure 17: Dot projection (above) and resulting wire frame data (below) of a chair 

It is important to note that when using dot projection with videogrammetry, the 
projected targets on the structure will not move with the structure but will instead move 
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as a result of the changing shape of the structure: the motion of a specific point on a 
structure cannot be tracked using dot projection. This makes dot projection inappropriate 
for vibration analysis. However, a time series of measurements can be made of the 
structure as a whole using dot projection as long as it is understood that the targets do not 
represent specific points on the structure. For example, the parabolic shape of a 
concentrator similar to the 5m concentrator could be measured using dot projection. If the 
internal pressure of the concentrator was varied with time, dot projection could be used to 
measure the changing shape of the concentrator (i.e. the changing focal length) as a 
function of time even though the trajectories of specific points on the concentrator could 
not be obtained using this method. 

To better understand which types of materials are most amenable to measurement 
by dot projection photogrammetry, a variety of materials were examined. The material 
properties of relevance to dot projection are reflectivity, absorptivity, and transparency. 
Reflectivity is of two types: specular reflection and diffuse reflection. Specular reflection 
occurs on surfaces that are smooth on a microscopic level, whereas diffuse reflection 
occurs on surfaces that are microscopically rough (Figure 18). With specular reflection, 
all of the light reflects in one direction and the surface behaves like a mirror. Therefore, 
the projected dots will be most visible in only one direction. With diffuse reflection, the 
light reflects in many directions, and projected dots will be visible from many locations. 
Because photo/videogrammetry uses multiple cameras in multiple locations, diffuse 
reflection is much preferred over specular reflection. 
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Figure 18: A microscopic perspective of how light reflects off a specular (left) and diffuse (right) 

surface 

Absorptivity and transparency are related in that both properties cause a loss of 
light reflected off a material. Darkly colored materials absorb more light than lightly 
colored materials, and materials that are more absorptive will be more difficult to 
measure using dot projection since the dots will appear dim on the structure. Transparent 
materials allow most of the light to pass through the material, and so highly transparent 
materials will also be difficult to measure using dot projection. 

This qualitative discussion leads to a recommendation for a diffuse, low- 
absorption, low-transparency material. To validate this recommendation, a series of 
experiments was carried out on various materials. Table 7 lists he materials that were 
examined and a qualitative description of their material properties. The opaque materials 
were attached to a vertical backing and the transparent materials were attached to 
supports at only the top and bottom. Dots were projected onto the materials and 
photographed under four conditions (Figure 19). 


Table 7: Qualitative description of material properties 


Material 

Reflection 

Transmission 

Absorption 

White Paper 

diffuse 

low 

low 

Kapton 500 MTB (black) 

diffuse 

low 

high 

Kapton 100CB (black) 

specular 

low 

high 


specular 

low 

low 

Kapton HN 100 G (gold) 

specular 

low 

medium 

Semi-transparent Mylar (gray) 

specular 

high 

low 

Semi-transparent Kapton (orange) 

specular 

high 

low 
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Case 1: Materials, camera, and projector are aligned, with ambient lights on 

Case 2: Materials, camera, and projector are aligned, with ambient lights off 

Case 3: Materials and projector are aligned, with the camera at an angle and ambient lights off 

Case 4: Camera and projector are aligned, with the materials at an angle and ambient lights off 


Materials 


Projector | 

o 


Camera 


Case 1 and 2 setup 

Figure 19: Experimental 


n 


6 


Case 3 setup 

setup of the dot projection cases 



An attempt was made to measure quantitatively contrast. Contrast was defined as 


the difference in intensity between the brightest part of the projected dot and the darkest 
part of the area surrounding it. This value can vary between different areas of the 


material, and so the maximum and minimum contrasts are given (Table 8). 


Table 8: Quantitative contrast measurements 


Material 

Case 1 

Contrast 

Case 2 
Contrast 

Case 3 
Contrast 

Case 4 
Contrast 

White Paper 

120, 107 

139, 125 

153, 146 

129, 106 

Kapton 500 MTB (black) 

158,51 

143, 86 

Not visible 

Not visible 

Kapton 100 CB (black) 

199, 46 

199,45 

Not visible 

Not visible 

Metalized Kapton (silver) 


218,48 

208, 31 

Not visible 

Kapton HN 1 00 G (gold) 

■ 

182*, 131 

230, 178 

Not visible 

Semi-transparent Mylar (gray) 

Not visible 


175, 50 

Not visible 

Semi-transparent Kapton (orange) 

Not visible 

Not visible 

240", 89 

Not visible 


’ Indicates that the CCD was saturated to the maximum intensity level of 255 in the region of a 
projected dot, and therefore the actual contrast may be higher than that measured here. 

It is desirable to have consistently high contrast levels with dots that are visible in 
all the configurations examined. The black Kapton materials provided a highly variable 
contrast level and were not visible in two of the configurations. The Metalized Kapton 
and Kapton HN, both of which had Metalized surfaces, provided high contrasts but also 
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had a tendency to generate hotspots (regions in which the image is overwhelmed with 
reflected light) and were not visible in one of the configurations. The semi-transparent 
materials also produced hotspots and were not visible in three of the configurations. The 
white paper provided the best overall visibility of the projected dots, which is consistent 
with the earlier hypothesis that a diffuse, low-transmission, and low-absorption material 
would be best. 

3-10: Matlab/PhotoModeler DDE System 

The two primary pieces of software used throughout this thesis research are 
Matlab and PhotoModeler. Matlab is a powerful technical computing environment, and 
PhotoModeler is a capable and easy to use photogrammetry software package. The 
strengths of these two separate software systems can be effectively combined using 
Dynamic Data Exchange (DDE). Dynamic Data Exchange allows separate computer 
programs to communicate in real time, and commands can be issued by one program and 
executed by another. This allows Matlab to use PhotoModeler as a “photogrammetry 
engine.” Matlab can use PhotoModeler to handle all of the complex photogrammetry 
calculations, and thus custom photogrammetry and videogrammetry software can be 
written in Matlab without having to recreate the involved programming of a completely 
new photogrammetry system. Matlab already has the basic functions required to 
manipulate images, and Matlab functions can be edited and expanded at anytime. DDE 
uses a library of functions determined by PhotoModeler, and that DDE library is already 
large and expanding. 

A DDE session is orchestrated as follows. Both Matlab and PhotoModeler must 
be running. Matlab initiates a DDE session using built-in functions and a PhotoModeler- 
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specific address. Once the session is initiated, Matlab can command PhotoModeler to 
execute a number of commands, and PhotoModeler can return information to Matlab 
such as data and error indicators. When the session is over, Matlab terminates the data 


exchange. 

A prototype photogrammetry system was successfully written in Matlab using the 
Matlab/PhotoModeler DDE capabilities (see “ddedemo.m,” p. A-6 in the Appendix). In 
this system, Matlab initiates a DDE session with PhotoModeler and commands 
PhotoModeler to mark and reference a series of target locations (two-dimensional points 
in a series of photographs) in a blank project. When all of the targets are marked and 
referenced, Matlab commands PhotoModeler to process the data. Once the data is 
processed, PhotoModeler returns the three-dimensional locations of the targets to Matlab, 
and the session terminates. Thus, Matlab is able to use PhotoModeler to 
photogrammetrically calculate the three-dimensional locations of targets. All that remains 
is to write a set of Matlab functions to handle sub-pixel target marking, target tracking, 
and image sequencing, and a Matlab/PhotoModeler-based videogrammetry system would 
be available, with all of the accuracy demonstrated by PhotoModeler and all of the power 
and flexibility available with Matlab (Figure 20). 



Figure 20: A possible layout for a full Matlab/PhotoModeler-based videogrammetry system 
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Chapter 4 : Recommendations for Future Work 

In this chapter, areas of potentially productive future research are suggested based 
on the results of the research conducted. Hardware issues and software development are 
examined, as are the promise of target coding and inflation control. 

4-1: Increased Number of Cameras and Software Development 

Future videogrammetric tests of deployable structures will benefit by using 
systems that use more than two cameras. There are three primary advantages to using 
such a system as opposed to a two-camera system: increased accuracy, increased 
precision estimation, and increased visibility of the test article during deployment. As the 
number of cameras viewing a target increases, the ratio of the number of equations to the 
number of unknowns in the bundle adjustment increases, improving accuracy. Precision 
estimates of the measurement can be generated by calculating the difference between the 
marked location of a target on a photograph and the projection of the calculated position 
of that target onto the photograph. If the same target appears in a sufficient number of 
photographs, the software can remove the camera views of that target having the largest 
discrepancy between measured point location and calculated point location, which will 
reject outliers in the solution calculation, which further improves both accuracy and 
precision. 

During the deployment process, targets visible to a particular camera at one stage 
of the deployment may become hidden from the view of that camera at a later stage due 
to the changing geometry of the test article. Conversely, targets that were once hidden 
from a particular camera may become visible. To effectively use a multi-camera system, 
targets that move into the view of a camera should be recognized, marked, and tracked to 
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increase the accuracy of the photogrammetric solution. Also, the ability to track a 
previously hidden target will negate the negative effects of losing the view of that target 
from another camera. 

When a target is visible from at least two cameras, it is possible to determine the 
three-dimensional position of that target. Given that the orientation and location of all the 
cameras is also known at this stage of photogrammetric measurement, it should be 
straightforward to project the location of the target onto the image planes of the cameras 
not already tracking that target. A target-marking algorithm could then begin to search for 
the previously hidden target in that area to determine if it has become visible. 
Consideration should be given to the case of multiple targets with distinct positions in 
space being projected onto the image plane in close proximity, thus creating a situation 
where the targets might be misidentified using this process. 

If the positions of a target cannot be determined due to a loss of target visibility, 
there are at least two methods to relocate that target using other cameras. The first is 
analyzing the trajectory of the target to predict a likely location of the target, and the 
second is using known constraints of the test article to locate the target position relative 
to other targets with known positions. The first method is described in Reference 12, 
where a process uses the past locations of a target with a Lagrange Polynomial to predict 
the likely subsequent location of that target. This location can then be used to begin a 
search for the target in the image planes of various cameras. 

The second method reduces the possible volume of space in which the target is 
located using the known locations of other targets on the structure. For example, consider 
a deploying tube one foot long and with three targets spaced every six inches. If the 
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locations of the top and bottom targets are known, then the location of the middle target 
is constrained to be within the intersection of two spheres centered at the two known 
targets and with radii of six inches. That is, the middle target cannot be located more than 
six inches from either the top or the bottom target. This reduces the space that must be 
searched to find the middle target in other camera views. 

4-2: Coded Targets 

Another way to identify newly visible targets is to use coded targets. Coded 
targets surround a central target with a set of visual markers: the central target is used in 
sub-pixel marking, and the perimeter code is used for automatic referencing. Coded 
targets are already implemented in many photogrammetric and videogrammetric systems, 
including VSTARS. The concept has been proven useful for many applications. 
However, a difficulty arises when considering the use of coded targets on deploying 
structures. 

If the central target of a coded target is to be the same size as a non-coded target 
(thereby giving both targets the same sub-pixel marking accuracy), the coded target must 
be physically larger than the non-coded target in order to accommodate the perimeter 
code. That means that more of the target must stay in the view of the cameras, especially 
considering that both the central target and the perimeter code must remain visible and 
distinct. This will restrict the measurable orientations of the target, but this problem 
might be alleviated by using several cameras spaced around the test article. It may also be 
advantageous to use a mixture of coded and non-coded targets, with the coded targets 
acting as “landmarks” for the photo/videogrammetry software, and the non-coded targets 
providing the majority of the three dimensional data. 
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4-3: Inflation Control 


The two largest problems encountered while conducting test measurements of 
tripod deployment were loss of target visibility and locking. In the far term, it should be 
possible to integrate real-time videogrammetric measurement and deployment control of 
deployable structures. This would allow for active prevention of both locking and loss of 
target visibility during deployment. For example, if the system detected a leg of a tripod 
passing near the edge of visibility, it could reduce the inflation speed of the other legs to 
draw the structure back into a better orientation. If the structure approached a locked 
configuration, the system could reduce pressure in one or more legs before completing 
the deployment. Such a system would also be of value for the deployment of inflatable 
structures in space, as it would simultaneously improve data collection of the deployment 
and act to keep the structure safe from damage during deployment. 
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Chapter 5 : Concluding Remarks 


Photogrammetry is a highly appropriate measurement technique for studying the 
static shape of ultra-lightweight and inflatable structures, and videogrammetry is equally 
well suited for studying the dynamics of these structures. However, it appears that the 
practical issues involved with measuring particular ultra-lightweight and inflatable 
structures will be problem-specific, and so a general-purpose photo/videogrammetry 
system will be most useful if it is highly flexible. Consideration must be given to both 
hardware and software flexibility and accuracy. 

It has been shown that consumer cameras with resolutions of 2-3 megapixels yield 
good precisions in photogrammetric measurements. Professional cameras with 
resolutions of 4-6 megapixels cost significantly more but should be expected to yield 
higher precision. The advantages of consumer cameras come from lower cost and faster 
product development. Because consumer cameras are less expensive, a larger number can 
be purchased for measurements. Fast product development is narrowing the gap in 
resolution between consumer and professional cameras, and because consumer cameras 
cost much less, it is more feasible to upgrade them when new technologies are brought to 
market. 

For static measurements in which the test article is rigid and in a suitable 
environment, a high-resolution, professional camera could image it from several locations 
by a photographer moving around the test article, yielding maximum accuracy. However, 
if the structure is not rigid (e.g., a membrane), multiple cameras may be required to 
image the article simultaneously from all necessary camera stations. In addition, if the 
structure is in an environment requiring remote operation of the cameras (e.g. a vacuum 
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chamber), multiple cameras will be required. Because both of these scenarios are likely to 
occur with ultra-lightweight and inflatable structures, multiple cameras will generally be 
required. For this purpose, a large number of consumer cameras may be most appropriate. 
However, the present gap in resolution between consumer and professional digital video 
cameras (0.3 vs. 1 megapixel) is large enough to require professional camera systems for 
high-precision measurements. Experiments involving the two video camera VMD2Cam 
videogrammetry system have illustrated the need for at least three or four video cameras 
for use in videogrammetry measurements of test articles that will undergo large changes 
in geometry. Digital video systems are capable of taking static images. Therefore, the 
optimal photo/videogrammetry system might incorporate a small number of professional 
digital video cameras for use in both static and dynamic measurements, as well as a 
number of supplemental consumer cameras for increased accuracy in static 
measurements. It is worth noting that PhotoModeler is capable of using images from 
cameras with varying resolutions in the same measurement. 

It has been shown that materials have a significant effect on how well 
measurements can be made using both photogrammetry and videogrammetry. When 
choosing between flat white and retro-reflective adhesive targets, consideration should be 
given to the lighting conditions and the expected orientations of the targets relative to the 
cameras. While dot projection techniques offer several advantages for measuring the 
shape of ultra-lightweight and inflatable space structures (e.g. tens of thousands of targets 
are almost instantly available for measurement without adding mass or stiffness to the 
structure), the materials used to make these structures are typically reflective or 
transparent. When using dot projection, materials like these are much more difficult to 
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measure than materials that are opaque, light colored, and diffuse, and so the materials 
used to create test articles may be dictated by how they are to be measured. 

A Matlab/PhotoModeler-based photo/videogrammetry system will likely yield the 
accuracy and flexibility required for an effective ultra-lightweight and inflatable space 
structure measurement system. The limiting factor in the accuracy of PhotoModeler 
appears to be the camera calibration technique. This could be improved with either more- 
refined and specialized calibration software or by determining the camera parameters in 
an optical laboratory. The DDE interface capability of Matlab and PhotoModeler should 
contribute significantly to the flexibility of the photo/videogrammetry system software, 
as should the likelihood of increased DDE capabilities in future versions of the 
PhotoModeler software. 

In a photo/videogrammetry system, the hardware and software must complement 
each other to be effective, and the same is true for the measurement system as a whole 
and the test article being measured. Test articles will need certain optical properties if 
they are to be effectively measured using either photogrammetry or videogrammetry. As 
more experience is gained making these types of measurements, both the test articles and 
the measurement systems will be improved and refined. Eventually this process will yield 
the validation necessary to capitalize on the immense potential of ultra-lightweight and 
inflatable structures in space-based applications. 
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Appendix 


All of the codes listed here were written by Louis Giersch during the course of the 
research described in the preceding chapters. This is not a complete list of every code 
written, but rather only the codes thought most important to the thesis. These codes may 
be reproduced and used as long as the following requirements are met: 

1 ) Credit is given to the original author 

2) It is understood that while no errors are known to exist in these codes, they are by 
no means guaranteed. The original author is by no means liable for any damages 
resulting from the use of these codes 

Digita script used for DC290 settings 

name "startup" 
mode 0 

menu "Kodak Scripts" 
label "startup” 

declare u: u Select ###Set up variables 

declare i: iFlagOn, iFlagOff ###Set up variables 
SetCameraState ("zpos", 100) ###Set Zoom, Min = 100, Max = 300 
DisplayLine ("Zoom: Fully Out") 

SetCameraState ("fmod", 3) ###Specifies focus mode, 3 = Manual 
SetCameraState ("fdst", 250) ### Set focus distance, 50 = Min 

DisplayLine ("Focus Distance: 5m") 

SetCameraState ("smod", 2) ### 2=Fill -Built-in flash fires in all situations. 

TheEnd: 

Cancel: 

Quit: 

Exitscript 

Matlab code “opendata2.m” used to read xyz and precision data exported from 
PhotoModeler 

function Pres_Pts = opendata2 (filename) 




opens the 
and reads 


file ’ filname : , a . tst fixe exported by 
the data into an array called Pres Pts which 


A-l 



% c o n t a i n s t h e p r ec i s i 01 1 o f x , y , a n d z 1 o c a t i on s a 55 


x , y , and 


ename is a string, for example: ’tabiel.txt 8 . The file must; 

%be located in a directory referenced as a oath by Mat lab. 


fid = f open ( filename , ' r*>; %open file in binary mode. 

n=l; %n is an index. 

line = fgetl(fid); %skip first line. 

while feof(fid) == 0 %stop while loop ’when end of file (EOF) is found, 
line = fgetl(fid); %get a (string) line from the file, 

spaces = isspace (line) ; %f ind the spaces in the string, 

numbers = find (-spaces) ; %find the non- spaces in the string, 

numl = n umb e r s ( 1 ) ; % t h e £ i r s t n umb e r s t a r t s a t t h e f 1 r s t n o n - s p ace. 
xl = 1; %s farting at the beginning of the string, 

whi le (numbers (xl+1) - numbe r s ( x 1 ) == 1 ) % f .1 n ci a j u rap i n n o n s p a c e 

% locations . 

xl = xl + 1; %move through the string, 
end %end search when jump is found. 

xl = xl + 1; 

num2 = numbers (xl); %this is where the second number on the line is. 

while (numbers (xl + 1 ) - numbers (xl) = = 1) %. search for another jump in 

xl = xl + 1; % non --space locations. 

end 

xl = xl + 1; 

num3 = numbers (xl) ; 

while (numbers (xl+1 ) - numbers (xl) == 1) ^search for another jump in 
xl - xl + 1; snon -space locations. 

end 

xl = xl + 1; 

num4 = numbers (xl); %this is where the fourth number on the line is. 

while (numbers (xl+1 ) - numbers (xl) -= 1) %search for another jump in 
xl = xl + 1; %non- space locations. 

end 

xl = xl + 1; 

num5 = numbers (xl); 

while (numbers (xl+1 ) - numbers (xl) == 1) % search for another jump in 
xl = xl + 1; 

end 

xl = xl + 1; 
num6 = numbers (xl); 
si = line (numl : num2-l ) ; 
s2 = line (num2 : num3-l ) ; 
s3 = line (num3 : num4-l ) ; 
s4 = line (num4 : num5-l ) ; 
s5 = line (num5 : num6-l ) ; 
s6 = line (num6 : length ( line ) 

Pres_Pts (n, 1 ) = str2num(sl) 

Pres„Pts (n, 2 ) = str2num(s2) 

Pres_Pts (n, 3 ) = str2num{s3) 

Pres_Pts (n, 4 ) = str2num(s4) 

Pres_Pts (n, 5 ) = str2num(s5) 

Pres_Pts (n, 6 ) = str2num(s6) 
n = n + 1 ; 

end 

fclose(fid); %dose file 


■ s p a o e i o c a. t, i on s . 


%get the sub strings containing 
%the three numbers . 


% convert from strings to actual 
% numbers , put into POINTS. 


%go to the next line. 
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Matlab function “fitparabola.m” used to fit xyz data to a parabolic surface 


function d2 = f itparabola (d, 

which is an axially symmetr 


%x ,y, z must be column vect 

% g r a ph i c s = 0 , 1 , 2 

%This function attempts to 

x = d ( : , 1 ) ; 
y = d ( : , 2 ) ; 
z = d ( : , 3 ) ; 

num_of_pts = length (x); 
if (num_of_pts < 4) 

e r r o r { ’ The r e mu s t b e a t 


a 


end 




maxitr, graphics) 



. ian 





the 



be r 



itr = 1; 

al = 10*2 *pi/360 ; « initial rotation ana 

an g red = .95; * reduce al by this mu 

showme = zeros (1, maxitr); 

while {itr <= maxitr) ^ Begin a 

vec = [x ' ;y ’ ? z ' ] ; 

sal = -sin (al ) ; % calculate sin, cos o 

cal = cos (al) ; i execuri on 

msal = -sin(-al); 3 

meal = cos(-al); i 

Rl = [100; 0 cal sal; 0 -sal cal]; % 

r 2 = [1 0 0; 0 meal msal; 0 -msal meal]; % 

R3 = [cal 0 sal; 0 1 0; -sal 0 cal]; * 

R4 = [meal 0 msal; 010; -msal 0 meal]; % 


vecl 

= (Rl 

*vec) 1 

% Rotate about x axis by 

xl = 

vecl ( 

:,1); 

a Results are Set 1 

yl = 

vecl ( 

: , 2 ) ; 

y. 

zl = 

vecl ( 

: , 3 ) ; 


vec2 

= <R2 

*vec) 1 

t Rotate about x axis by 

x2 = 

vec2 ( 

:,1); 

i Res u 1 1 s a r e S e t 2 

y2 = 

vec2 ( 

'., 2 ); 

■*. 

z2 = 

vec2 ( 

: , 3 ) ; 


vec3 

= (R3 

*vec) 1 

; Vj Rotate about y axis ny 

x3 = 

vec3 { 

:<!)< 

% Results are See 3 



f a I he 



al 


■araboloid ' 






1 1 O O r\ 
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y3 

z3 


= vec3 ( : , 2 ) ; 
= vec3 ( : , 3 ) ? 


vec4 = (R4*vec) ' ; % Rotate about y axis by -al 
x4 = vec4 ( : , 1) ; % Results are Set 4 

y4 = vec4 ( : , 2 ) ; % 

z4 = vec4 ( : , 3 ) ; % 


index2 = 1; 
while (index2 <= 4) 

if(index2 = = 1) 
xc = xl ; 
yc = yl; 
zc = zl; 

end 

if ( index2 == 2 ) 
xc = x2 ; 
yc = y2 ; 
zc = z2; 

end 

if ( index2 - = 3 ) 
xc = x3 ; 
yc = y3 ; 
zc = z3; 

end 

if ( index2 == 4 ) 
xc = x4 ; 
yc = y4 ; 
zc = z4; 

end 


%% Start surface fit 
% This section calculates the surface parameters 
% (including RMS error) for all of the data sets ( 
% 4), starting with Set 1 (e.g. on the first pass 
u t h r c ' u g h , t lie c u r r e n t s e t [ x c , yc , z c j i s S e t 1 , 
% on the second oass the current se= _ i s 3or 2 
% etc.), index2 indicates the current pass . 


A = zeros (num_of_pts , 5 ) ; 

A ( : , 1 ) = xc. A 2; 

A( : ,2) = yc.^2; 

A ( : , 3 ) = xc; 

A( : ,4) = yc ; 

A ( : , 5 ) = ones (num_of_pts , 1 ) ; 
b = zc; 

fit_vector = zeros (5,1); 

fit__vector = inv (A ' *A) *A ’ *b; 

a = f it_vector ( 1 ) ; 

b = f it_vector (2 ) ; 

c = f it__vector (3 ) ; 

d = f it_vector (4 ) ; 

e = f it_vector ( 5 ) ; 

f ocal_length_xl = l/(4*a); 

f ocal_length_yl = 1/ (4*b) ; 

zp = a*xc.^2 + b*yc. A 2 + c*xc + d*yc + e; 

diff = zc - zp; 

max (dif f ) ; 

er ( index2 ) = sum ( di f f . A 2 ) ; 
index2 = index2 + 1 ; 
end 


% This section does the 
% a c t ua i s u r f a c e f i 1 1 i ng an 
% determines the focal 
% lengths and the RMS. The R 
% of each set are stored in 
% t h e v e c t o r e r , s o t ha t. t h 
% set with the smallest RMS 
% error can be found once a 
% of the sets have been 
% analyzed . 


Surface fit 


if (find (min (er ) ==er) 
x = xl ; 
y = yl; 


1) % This section picks out the set with 

% t h e sma. 1 1 est RM 3 e r ro r ( m i n ( e r ) ) , and 
t sets up the next iteration to use that 
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z = z 1 ; 
showme (itr) 

end 

if ( find (min (er) 
x = x2 ; 
y = y2; 
z = z2 ; 
showme ( itr) 

end 

if ( find (min (er ) 
x = x3 ; 

y = y3; 
z = z 3 ; 
showme (itr) 

end 

if { find (min (er) 
x = x4 ; 
y = y4 ; 
z = z 4 ; 
showme ( itr ) 

end 

al = al*angred; l Reduced the size of a 

itr = itr + 1; go to the next alignrn 



f ocal_length = abs ( f ocal_length_xl + f ocal_length_yl ) /2 

f ocal_pm = abs ( f ocal_length - abs ( f ocal_length_xl ) ) 

zp = a*xc. A 2 + b*yc. A 2 + c*xc + d*yc + e; 

diff = zc - zp; 

average_error = mean (diff) 

sum_square_error = sum (diff . A 2 ) ; 

RMS = norm (diff) /sqrt ( length (diff ) ) -door. --me an ••square ( RMS ) 
err = diff. A 2; 

aver = 1 . 1 *sum_square_error/ length (x) ? 

d2x = x(find(err < aver) ) ; 

d2y = y (find (err < aver)); 

d2z = z(find(err < aver)); 

d2 - [d2x 1 ; d2y ' ; d2z ' ; ] 1 ; 

ti%The rest of the code is graphics 

figure ( 4 ) ; 

plot ( [1 : 1 rmaxitr ] , showme); 
x2 = min (x) : (max (x) - min (x) ) i 50 ;max (x) ; 
y2 = min (y) : (max (y) - min (y ) ) / 50 : max (y ) ; 
z2 = zeros (length (x2) , length (x2)); 
n = 1:1: length (x2 ) ; 
m = 1 ; 

while m <= length (x2) 

z2 (m, n) = a*x2 (m) . A 2 + b*y2(n). A 2 + c*x2 (m) + d*y2 (n) + e; 
m = m + 1 ; 

end 

if (graphics >= 1) 
close all; 
figured) ; 
circ (x, y , dif f *30 ) ; 
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xlabel (' radii are proportional to the difference between expected 
a nd a c t. u a i z v a i u e s ( ou t o f p 1 a n e ) ' ) ; 

ylabel { s treat ( 1 average error ’ , num2str(average_error) , ' , RMS -- * , 
num2str (RMS ))); 

title ( strveat {' z ---• a*x A 2 + b*.y A 2 + c*x + d*y + e ' , streat ( ' a •- 
' # num2 str(a) , ' ( b ~ ’ , num2 str(b) , ’ ,c = ' , num2 str(c) , ' ,d 

“ / num2str(c) , ! , e = ' ,num2str(e) ) , streat ( ‘ focal length - 4 , 

num2str ( f ocal_length) , ' , +- ' , num2str ( f ocal_pm) ) ) ) ; 

axis equal; 

end 

if (graphics >=1 )& (graphics <-2 ) 
figure (2 ) ; 
mesh (x2 , y2 , z2 ) ; 

title ( strveat ( 1 z a*x A 2 •*- b*y A 2 + c*x + d*y + e', streat (’a 

’ , num2 s t r ( a ) , 1 , b - ’ , num2 str ( b ) , ’ , c = ' , num2 s t r { c ) , 1 , d = 

! , num2str (c) , ' , e = 1 , num2str (e) ) , streat ( ‘ focal length = ’ , 
num2str ( f ocal_length) , ' , +- 1 , num2str ( f ocal_pm) ) ) ) ; 

hold on; 

plot3 (x, y , z # 1 . 1 ) ; 
axis equal; 
a z = 90; 
rotate3d on; 
end 

if (graphics == 2) 
figure ( 3 ) ; 
elf ; 

plot 3 (x, y, z f ' b. ’ ) ; 
hold on; 

plot3 { [x] , [y] , [zp] , ' r . * ) ; 
xlabel ( 1 x ' ) ; 
ylabel ( ' y 1 ) ; 
rotate3d on; 
axis equal; 

end 

Matlab function “ddedemo” used to demonstrate viability of Matlab/PhotoModeler 
DDE system 


function ddedemo 
close all; 
clear all; 

% Ph o t oM o d e 1 e r 1 s DDE c omm and s t a. k e a v e ry s i rap ]. e f o r m . 

%Oniy the "DDE Initiate", "DDE Request" and "DDE Terminate" messages 

0 y- o \ ) cp(j ^ 

%A11 PhotoModeler DDE commands are ASCII text strings and. are of the 
romat : 

% " comrriandNarne coiornandParaml commandParml commandParamB . . 

%All commands return values and a return code indicating success or 
iiai lure . 


%Phot.oModeler * s DDE commands are NOT case sensit. 
bthe commands "GetNext Point . " , H getnextpoint * and 
equivalent . 


. ve . r'o r e xamp 1 e . 
n GETNEXTPOINT " are ai: 


% " MP Photo Mum 3DPo.int.iD x y" where PhotoNum is a valid photograph number 
% (as returned by GetPhotoList ) , 3DPointID is a valid 3D Point ID 
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X 






;ixej 




a no 


format compact; 

the X \ ci a t a 


XYs = opendatatr ( ’ s 

tage - t 

Xt • ) ; 

camlid = XYs (1,1); 
XY1 = XYs (find (XYs ( 

: / 1 ) = 

= camlid) , : ) ; 

XY2 = XYs (find (XYs ( 

: / 1 ) ~ 

= camlid) , : ) ; 

XY1 = ordertr (XY1 , 
XY2 = ordertr (XY2, 
XI = XY1 ( : , 3 ) ; Y1 

2) ; 

2) ; 

= XY1 ( 

: / 4 ) ; 

X2 = XY2 ( : , 3 ) ; Y2 

= XY2 ( 

: , 4 ) ; 

close all; 

FIG1 = figured); 
hold on; 

set (FIG1 , ‘ P o s i t i on 

’ , [6 

144 790 146] ) ; 

subplot (1,3,1) 
plot (XI, -Yl, ’o’ ) ; 

axis equal; axis off; 

subplot (1,3,2) 
plot (X2, -Y2, ’re*’ ) ; 

axis 

equal; axis off 

% On 1 v t h e M D D E I n i f 

i a t e ‘* , 

"DDE Request" 






[• e r m i n a. t e " m e s s a-g e s 




disp('NOTE: PhocoModeler must be running*); 
disp(’ Press any key to mark points’); 

figure (1) ; 
pause 

disp{ ’Mark points in PhotoModier. . . 1 ) ; 

channel = ddeinit ( ’ PhotoModeler ? f 1 Data ’ ) ; 
commando = 1 OpenPro j eot d : \Mat labxdde \blank . parr ’ ; 

OpenProj = ddereq (channel , commando , [1 1]); 

photos = ‘blank’; 

RL = ’ ResetLists ' ; ResetList = ddereq { channel , RL , [1 1] ) ; 

GPL = ■ GetPhotoList ’ ; photos = ddereq ( channel , GPL , [1 1]); 

GNP = ’ GetNumBDPoints * ; NumberOf 3DPoints = ddereq (channel , GNP, 
GNPID = * GetNextPointID ’ ; NextPointID = ddereq { channel , GNPID, 


[1 1 ]) 
[1 1 ] ) ; 


«&ark Points 

index = 1; 

maxindex = (length (XI) ) ; 
while (index <= maxindex) 

c = s treat ("MP 1 ’ , { ’ ’ }, num2str ( index) , {’ 1 } # num2str (XI ( index) , 7 ) , 

{ * 1 } , num2str ( (Y1 ( index) ) , 7 ) ) ; 

c = char ( c ) ; % convert c from an array to a string 
out = ddereq (channel , c); 

c = s treat ( ’ MP 2 * , { ’ ’}, num2str ( index) , {’ ’ ) # num2str (X2 { index) # 7 ) , 

{’ 1 } , num2str ( ( Y2 ( index) ) , 7 ) ) ; 

c = char ( c ) ; k convert c from an array to a string 
out = ddereq (channel , c) ; 
index = index + 1; 

end 


disp( ’ Processing the data in PhotoModier . . . 1 ) 

ProcessData = ddereq (channel Process 13 ! , [1 1]) 

-c C o 1 1 e o t 3 D d a t a. 

ResetList = ddereq ( channel , RL , [1 1]); 
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GNP3D = ' GetNextPoint 1 ; 

index = 1 ; 

while (index <= maxindex) 

point3D = ddereq ( channel , GNP3D, [1 1]); 
point3Dn = str2num (point3D) ; 
XYZ(index,l) = point3Dn(2); -l ID 
XYZ(index,2) = point3Dn(5); %x 
XYZ(index,3) = point3Dn{6); %y 
XYZ (index, 4) = point 3 Dn (7); 

if {point3Dn ( 3 ) ~= 1) 



end 


index = index + 1 ; 

end 

subplot (1,3,3) 

plot3 (XYZ ( : , 2) , XYZ ( : , 3) , XYZ ( : , 4) , ’ k. ' ) ; 

axis equal; axis off; 
rotate3d on; view( [122 56]); 

i f ( ddeterm ( channel ) ) 

disp ( ' dde session successfully endecs' ) ; 
else 

disp ('dde session unsuccessfully ended’); 

end 

subplot (1,3,1) 

title ( 1 Image points I ' ) 

subplot (1,3,2) 

title ( ’ Image points 2 1 ) 

subplot (1,3,3) 

title ( ' 3D points * ) 

format loose; 

Matlab function “RealSpace” used to simulate the camera views of a dynamic, 3d 
object 

function RealSpace 

! f uric 1 1 on Real Space , wri z ten by toui s seh 

%used to simulate the views of two cameras on a dynamic, 3d object 

close all; 

X= [0-1.51001-1.50]; % 

Y = [-.2 - . 2 -.2 -.2 .2 .2 .2 .2]; % the 3d obj act 

Z = [1 1.53 4431.51]; 

cl = 4; c2 = 4; % focal lengths of cameras 1,2 

Ml = [00-1; 010; 1 0 0]*[1 0 0; 001; 0-10]; % rotation matrix 

for camera 1 

M2 = [10 0; 0 0 1; 0 -1 0 ] * [-1 0 0; 0 10; 0 0-1]; % rotation matrix 

for camera 2 

XI = 5 ; Y 1 = 0 ; Z1 = 2.5? ^position of camera 1 
X2 = 0; Y2 = 5; Z2 = 2.5; ^position of camera 2 
a = .1; %initiai angle of 3d object 

FI = figure (1) ; 

set (FI , ' Renderer 1 , ‘ z buffer ’ ) ; 

hold on; 
subplot (2,3,1) 
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while ( 1 == 1) 

Rot_mot = [cos(a), sin(a), 0; -sin(a) cos (a) 0; 0 0 1]; V; 

XYZ = [X; Y; Z); % rotate 

the 3d object 

XYZn = Rot_mot*XYZ; t 

X = XYZn ( 1 , : ) ; * 

Y = XYZn (2 , : ) ; t 

Z = XYZn (3, : ) ; * 

elf ; 

subplot (2,3,1) 

hold on; axis equal; title ( 1 input xyz ! ) 
plot3 (X, Y, Z); 
plot3 (X, Y, Z, 1 . 1 ) ; 

plot3 (XI , Yl, Zl, 1 rx'); plot3([0 XI], [0 Yl], [Z1 Zl], ’ r'); 

plot3(X2, Y2 , Z2, ’re’); plot3([0 X2 ] , [0 Y2 ] , [Z2 Z2 ] , ‘r 1 ); 

view( [1,1, . 5 ] ) 

axis ([-52-52-25]) 

subplot (2,3,2) 

hold on; title ( 1 Carrier a 1 (>:)') 

xl = -cl* {Ml (1, 1) * (X-Xl) + Ml (1, 2) * (Y-Yl) + M1(1,3)*(Z- 
Zl) ) . / (Ml (3 , 1) * (X-Xl) +M1 (3,2)* ( Y-Yl ) + Ml ( 3 , 3 ) * (Z-Zl ) ) ; * calculate 

yl = -cl* (Ml (2 , 1) * (X-Xl) + Ml (2,2) * (Y-Yl) + Ml (2,3)* ( Z- 
Zl) ) . / (Ml (3 , 1) * (X-Xl) +M1 (3,2) * (Y-Yl) + Ml ( 3 , 3 ) * (Z-Zl ) ) ; % 
plot(xl, yl ) ; plot(xl, yl , ’ . ’ ) ; axis ([-2 2 -2 2]); 

subplot (2,3,3) 

hold on; title ('cam 1 check') 
plot ( Y, Z ) ; plot(Y,Z, ‘ . 1 ) ; axis ( [ -2 2 0 4]); 
subplot ( 2 , 3 , 5 ) ; hold on; title ( 1 Camera 2 io) ’ ) 
x2 = -c2* (M2 (1, 1) * (X-X2) + M2 ( 1 , 2 ) * ( Y-Y2 ) + M2(1,3)*(Z- 
Z2) ) . / (M2 (3, 1) * (X-X2) +M2 (3,2) * (Y-Y2) + M2 (3,3) * (Z-Z2) ) ; ^calculate 
c am ex' a 2 v i ew 

y2 = -c2 * (M2 ( 2 , 1 ) * (X-X2 ) + M2 ( 2 , 2 ) * ( Y-Y2 ) + M2(2,3)*(Z- 
Z2) ) . / (M2 (3, 1) * (X-X2) +M2 (3,2) * (Y-Y2) + M2 ( 3 , 3 ) * ( Z-Z2 ) ) ; 1 
plot (x2 , y2 ) ; plot (x2 , y2 , 1 . ’ ) ; 

axis ( [ -2 2 -2 2 ] ) ; 
subplot (2,3,6) 

hold on; title ( 1 cam 2 check') 

plot (X, Z ) ; plot (X , Z , ’ , 1 ) ;axis( [-2 2 0 4]); 

pause (.01) ; 

tic ; 

while (toe < .1) 
drawnow; 

end 

end 

Matlab function “k_caml” used to simulate the K1 distortion of a DC290 camera 

function k_caml 

K1 = 0.00174 
K2 = -4.27E-5 
PI = 0.41E-5 
P2 = -9.38E-5 
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x = 7,537; % In mm 
y = 5.04; % In nun 

scale = 170/5.04 % inches in object space/mm on CCD 

X0 = zeros (10,10) ; 

Y0 = zeros (10,10) ; 
m = 1:1: length (X0(1, :)) A 2; 
n = 1 ; 

while (n <= length (X0 (:, 1 )) ) 

X0(:,n) = . l*x* (n- .5 - . 5*length (X0 (:, 1 ))) *ones ( length (X0 (:, 1 )), 1 ) 
n = n + 1 ; 

end 

X0 

pause 
n - 1 ; 

while (n <= length (Y0 (:, 1 )) ) 

Y0 (n , : ) = . l*y*(n- .5 - . 5*length (X0 (:, 1 ))) *ones ( length (X0 (:, 1 )), 1 ) ' 
n = n + 1 ; 

end 

Y0 

close all; 

R2 = X0."2 + Y0.^2; 

XKl = X0 + Kl.*X0.*R2; 

YK1 = Y0 + K1.*Y0. *R2; 
hold on; 

plot (X0, Y0, 'ki) ; 
plot (XKl, YK1 , ’ ko ’ ) ; 

del = ( {X0 - XKl ) . A 2 + (Y0 - YK1) . A 2) . A .5; 
maxdist = max (max (del )) ; 

title { strvcat ( s treat ( ' K1 = ' , num2str (Kl) )));*, s treat ( ! maximum 
distortion (nun) - 1 , num2str (maxdist , 3 ) ) , streat ( 1 If the scene is 170 

nurn2st.r ( scale * maxdist , 3 ) , ? (in. ) ' ) ) ) ; 

axis image; 
axis off; 

Matlab function “LGVS3,” A prototype target tracking videogrammetry system 
using Matlab/PhotoModeler DDE 


function LGVS3 

% function LG VS 3 , Written by Louis Giersch 



close all; clear 

all; 


d i s p ( ’open i n g i m 

age f i 

| » 1 J 

disp ( ' al . jpg ' ) 
al = imread ( 1 al . 

jpg ’ r 

’ jpg ' ) 

disp ( ' a2 . jpg ' ) 
a2 = imread ( ’ a2 . 

jpg' / 

'jpg' ) 

disp ( ' a 3 . jpg ' ) 
a3 = imread ('a3. 

j pg ' , 

’jpg' ) 

disp ( 1 a 4 . jpg 1 ) 
a4 = imread ( * a 4 . 

jpg’ / 

‘ jpg ' ) 

disp ( ' a5 . jpg ' ) 
a5 = imread ('a5. 

j pg ' / 

' jpg' ) 

disp ( ’ bi . jpg ’ ) 
bl = imread ( ’ bl . 

jpg’ / 

' jpg ' ) 
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' j pg 1 ) ; 


disp ( * b2 . jpg ’ ) 
b2 = imread ( ’ b2 . jpg ’ , 
disp { ' b3 . jpg 1 ) 
b3 = imread ( ’ b3 . j pg ’ , pi pg ’ ) ; 
disp { 'b4.jpg 1 ) 

b4 = imread ( ’ 1:4 . jpg ’ , ' jpg ’ ) ; 

disp { ‘b5.jpg 1 ) 

b5 = imread ( ' b5 . jpg ! , 'jpg'); 

FI = figure(l); image (al); title ( ’ camera A'); axis image; 
F2 = figure (2); image (bl); title (’ carrier a B 1 ); axis image; 
F4 = figure ( 4 ) ; 


set { Fl , 1 Pos i t. i on 1 

, [152 

31 

647 

532] ) 

set ( F2 , ’ Position ’ 

, [152 

31 

647 

532] ) 

s et { F4 , ’ Po s :L t. i on ’ 

, [120 

515 

104 

7] ) ; 

[ MAXy , MAXx , j unk ] 

= size(al) 

; 


BOXs = 30; 
GO = 1; 
FINDEX = 1; 
numpt = 1 ; 






. ra a. o* 

o i r'i t 

sA At 

SsTitWi 

figure { 1 ) 
while (GO == 1 ) 

[lx, ly, donow] = 
hold on; 

ginput 

(1) ; 



i f { lx + BOXs + 1 ) 

> MAXx 




lx = MAXx - BOXs - 1; 

end 



if (lx - BOXs - 1 ) 

< 0 




lx = BOXs + 1; 

end 





if(ly + BOXs + 1) > MAXy 

ly = MAXy - BOXs - 1 ; end 
if (ly - BOXs - 1) < 0 
ly = BOXs + 1 ; end 

i f donow > 1.5 
GO = 0; 
else 

CamAlguess ( numpt , :) = [lx, ly] ; numpt = numpt + 1; 

plot { [ lx+BOXs , lx+BOXs , lx-BOXs , lx-BOXs, lx+BOXs], [ly+BOXs, ly- 
BOXs, ly-BOXs , ly+BOXs, ly+BOXs], 1 g ’ ) ; end 
end 


+ ^ % Tv] v* p p jr, /•••> i” P\ P. p G 1 T1 i" 3% % % % % % 

figure (2); pause (1); donow = 1; 

GO = 1; FINDEX = 1; numpt = 1; 
while (GO == 1) 

[lx, ly, donow] = ginput(l); 
hold on; 

if (lx + BOXs + 1) > MAXx 

lx = MAXx - BOXs - 1; end 
if (lx - BOXs - 1) < 0 
lx = BOXs + 1 ; end 
if ( ly + BOXs + 1) > MAXy 

ly = MAXy - BOXs - 1; end 
if (ly - BOXs - 1) < 0 
ly = BOXs + 1 ; end 
if donow == 3 
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donow2 = input (' type 2 to track:’); 
if donow2 == 2 
GO = 0; end 
if donow2 == 3 

GO = 0; break; end 

else 

CamBlguess (numpt , :) = [lx, ly] ; numpt = numpt + 1; 

plot ( [lx+BOXs, lx+BOXs , lx-BOXs, lx-BOXs , lx+BOXs] , [ly+BOXs, ly- 
BOXs, ly-BOXs, ly+BOXs, ly+BOXs], 'g'); end 
end 

Alpoints = LGtrack (al, CamAlguess, numpt, BOXs, 1); 

Blpoints = LGtrack (bl , CamBlguess, numpt, BOXs, 2); 

channel = DDEinit; XYZ1 = DDE3d (Alpoints , Blpoints, channel); 

DDEend ( channel ) ; 

A2points = LGtrack (a2, Alpoints, numpt, BOXs, 1) ; 

B2points = LGtrack (b2, Blpoints, numpt, BOXs, 2); 

channel = DDEinit; XYZ2 = DDE3d (Alpoints , Blpoints, channel); 

DDEend ( channel ) ; 

A3points = LGtrack (a3, A2points, numpt, BOXs, 1); 

B3points = LGtrack(b3, B2points, numpt, BOXs, 2); 

channel = DDEinit; XYZ3 = DDE3d (Alpoints , Blpoints, channel); 

DDEend (channel ) ; 

A4points = LGtrack (a4 , A3points, numpt, BOXs, 1); 

B4points = LGtrack (b4, B3points, numpt, BOXs, 2); 

channel = DDEinit; XYZ4 = DDE3d (Alpoints , Blpoints, channel); 

DDEend ( channel ) ; 

A5points = LGtrack (a5 , A4points, numpt, BOXs, 1); 

B5points = LGtrack(b5, B4points, numpt, BOXs, 2); 

channel = DDEinit; XYZ5 = DDE3d (Alpoints , Blpoints, channel); 

DDEend (channel ) ; 

F3 = figure (3); elf; title ('3D'); axis image; 

set (F3 , 'Position', [152 31 647 532]); set(F3, 'Renderer', -sbuffer' ) 
while (1 == 1) 

plot3 (XYZ1 ( : , 1 ) , XYZ1 ( : , 2 ) , XYZ1 ( : , 3 ) , ' k . ' ) ; view( [-74 . 5000 14]); 
pause ( .01) ; drawnow; 

plot3 (XYZ2 ( : , 1 ) , XYZ2 ( : , 2 ) , XYZ2 ( : , 3 ) , ' k . ' ) ; view ([ -74 . 5000 14]); 
pause ( .01) ; drawnow; 

plot 3 (XYZ3 ( : , 1 ) , XYZ3 ( : , 2 ) , XYZ3 ( : , 3 ) , ' k . ' ) ; view ([ -74 . 5000 14]); 
pause ( .01) ; drawnow; 

plot3 (XYZ4 ( : , 1 ) , XYZ4 ( : , 2 ) , XYZ4 ( : , 3 ) , ' k . ' ) ; view ([ -74 . 5000 14]); 
pause (.01); drawnow; 

plot3 (XYZ5 ( : , 1 ) , XYZ5(:,2), XYZ 5 ( : , 3 ) , ' k . ' ) ; view( [ -74 . 5000 14]); 
pause (.01); drawnow; 

plot 3 (XYZ 4 ( : , 1 ) , XYZ4 ( : , 2 ) , XYZ4 ( : , 3 ) , ' k . ' ) ; view( [-74 . 5000 14]); 
pause ( . 01 ) ; drawnow; 

plot3 (XYZ3 ( : , 1) , XYZ3 ( : , 2 ) , XYZ3 ( : , 3 ) , ' k . ' ) ; view ([ -74 . 5000 14]); 
pause ( .01) ; drawnow; 

plot3 (XYZ2 ( : , 1 ) , XYZ2 ( : , 2 ) , XYZ2 ( : , 3 ) , ' k . ' ) ; view ([ -74 . 5000 14]); 
end 
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function newxy = LGtrack(IM, oldxy, numpt, BOXs , fign) 
figure (fign) 
image ( IM) ; 

JJIND = 1; 

FINDEX = 1; 

while JJIND < numpt 

lx = oldxy (JJIND , 1); ly = oldxy(JJIND, 2); 

plot ( [lx+BOXs, lx+BOXs , lx-BOXs, lx-BOXs, lx+BOXs], [ly+BOXs, ly-BOXs, 
ly-BOXs, ly+BOXs , ly+BOXs] , ’g'); 

JJIND = JJIND + 1; 

lx = round (lx) ; ly = round(ly); 

ac = lx - BOXs : 1 : lx + BOXs; ar = ly - BOXs : 1 : ly + BOXs; 
area = double ( IM (ar, ac) ) ; 

[xout, yout] = LGVS_cent (area) ; 

xout = xout + lx - BOXs; yout = yout + ly - BOXs; 
figure (fign) ; plot (xout, yout, ' r+ 1 ) ; zoom out; drawnow; 
newxy { FINDEX, :) = [xout yout]; 

FINDEX = FINDEX + 1; 
end 



function channel = DDEinit 

disp ( * Initiating DDE sesion. . . f ) ; 

channel = ddeinit ( ' Pho toModeier ' , ' Data ’ ) ; 

c ommand 0 = 1 On e n P r o j e c t d : \ Ma 1 1 ab \ dae \ b i a n K 2 9 0 . pmi ; 

OpenPro j = ddereq { channel , commando , [1 1]); 

photos = 'blank'; 

RL = ' ResetLists ' ; ResetList = ddereq (channel , RL, [1 1] ) ; 

GPL = 'Get.Phot.oL.ist.’; photos = ddereq (channel , GPL , [1 1]); 

GNP = 1 GetNunO DPo int s * ; NumberOf 3DPoints = ddereq ( channel , GNP , [11]); 

GNPID = ' GetNextPoint ID ' ; NextPointID = ddereq ( channel , GNPID , [1 1]); 



function XYZ = DDE3d (Axy , Bxy, channel) 
index = 1; 

RL = 'ResetLists'; GPL = ' GetPhotoList ' ; GNP = ' GetNumJDPoin ts ' ; GNPID 


= ' G e t M e x t Po i n 1 1 D ’ ; 

maxindex = ( length (Axy ( : , 1 ) ) ) ; 
while (index <= maxindex) 

c = strcat ( ' MP 1 ' / { ’ ’}, num2str (index) , {’ 

‘ } , num2str ( Axy ( index, 1 ) , 7) , { f 1 } , num2str ( (Axy (index, 2) ) , 7) ) ; 

c = char(c); ^convert c from an array to a string 
out = ddereq (channel , c) ; 

c = strcat ( ' MP 2 1 , { ' ’ } , num2str ( index) , {’ 

' } , num2str (Bxy (index, 1) , 7) , { ’ ' } , num2str ( (Bxy (index, 2 ) ) , 7) ) ; 

c = char(c); ^convert c from an array to a string 
out = ddereq (channel, c) ; 
index = index + 1; 

end 

disp ( ’ Processing the data m PhotoModrei * * * ) 

ProcessData = ddereq ( channel Process 13', [1 1]) 
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ResetList = ddereq ( channel , RL , [1 1]); 

GNP3D = 1 GetNext Point 1 ; 

index = 1; 

while (index <= maxindex) 

point3D = ddereq ( channel , GNP3 D , [1 1 ] ) ; 

point3Dn = str2num (point3D) ; 

XYZ ( index, 1 ) = point3Dn(5); %x 
XYZ (index, 2) = point3Dn(6); %y 
XYZ (index, 3) = point3Dn(7); %z 
if (point3Dn ( 3 ) ~= 1) 
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end 

index = index + 1 ; 

end 


f n-p ( ') \ \ 
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function DDEend ( channel ) 
if { dde term {channel ) ) 

disp(’dde session successfully ended'); 
else 

disp( ’dde session unsuccessfully ended' ) ; 

end 

%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%% 
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